Three-dimensional body scanning and apparel recommendation

ABSTRACT

Devices, systems, and methods include a three-dimensional (3D) scanning element, an electronic data storage configured to store a database including fields for 3D scan data and demographic information, a processor, and a user interface. In an example, the processor obtains 3D scan data of a body part of a subject from the 3D scanning element, analyzes the 3D scan data for incomplete regions, generate a composite 3D image of 3D scan data from the database based on similarities of demographic information, and overlays composite 3D image regions corresponding to incomplete regions on the 3D scan data.

PRIORITY

This application is a continuation application of U.S. patentapplication Ser. No. 15/727,819, filed Oct. 9, 2017, which applicationis a continuation of U.S. patent application Ser. No. 15/169,264, filedMay 31, 2016, issued on Aug. 28, 2018 as U.S. Pat. No. 10,062,097, whichapplication claims the benefit of priority to U.S. Provisional PatentApplication No. 62/168,527, filed May 29, 2015, the contents of allwhich are incorporated herein by reference in their entireties.

TECHNICAL FIELD

The subject matter disclosed herein generally relates tothree-dimensional scanning of body parts and recommendations for apparelfor that body part.

BACKGROUND

Three-dimensional (“3D”) scanning of human and animal body parts hasbeen utilized to provide high resolution scans of such body parts.Technologies such as laser scanning and visual imaging can, incontrolled settings, produce 3D scans with millimeter accuracy orbetter. Such precise scans allow for the precise fitting of variousarticles and devices, including medical and medical-grade devices amongother items.

BRIEF DESCRIPTION OF THE DRAWINGS

Some embodiments are illustrated by way of example and not limitation inthe figures of the accompanying drawings.

FIG. 1 is a depiction of a 3D scanner in relation to a human foot, in anexample embodiment.

FIG. 2 is a block system diagram of electronics of a scanner and/or asystem related to the scanner, in an example embodiment.

FIG. 3 is a flowchart for using demographic data to interpolate portionsof a foot from the 3D scan, in an example embodiment.

FIG. 4 is a heat diagram of a 3D scan of a foot as displayed on a userinterface, in an example embodiment.

FIG. 5 is a flowchart for evaluating changing characteristics of a footor article of footwear over time, in an example embodiment.

FIGS. 6A-6D are depictions of a user interface screen of the userinterface, in an example embodiment.

FIG. 7 is a flowchart 700 for iteratively updating a virtual foot basedon user responses, in an example embodiment.

FIG. 8 is a block diagram illustrating components of a machine,according to some example embodiments, able to read instructions from amachine-readable medium.

DETAILED DESCRIPTION

Example methods and systems are directed to three-dimensional scanningof body parts and recommendations for apparel for that body part.Examples merely typify possible variations. Unless explicitly statedotherwise, components and functions are optional and may be combined orsubdivided, and operations may vary in sequence or be combined orsubdivided. In the following description, for purposes of explanation,numerous specific details are set forth to provide a thoroughunderstanding of example embodiments. It will be evident to one skilledin the art, however, that the present subject matter may be practicedwithout these specific details.

Precision scanning in controlled environments can be comparativelyonerous, both for the subject of the scan and technicians conducting thescan. Because of the need for precision, the subject of the scan mayhave to remain immobile in a scanner for tens of seconds or more. In aphysician's office, for instance, such may not be perceived as a burden.However, in a commercial or casual setting, the subject of the scan maybe made uncomfortable, impatient, or otherwise have the quality of theirexperience reduced by having to undergo medical-like experiences inorder to obtain the benefits of precision 3D scanning.

In various cases, 3D scanning may be provided that is faster andless-intrusive than medical-grade scanning, generally at the expense ofaccuracy and, in various cases, user experience. However, relativelyprecise 3D scanning may be advantageous in order to produce desiredproduct recommendations or custom products for customers. For instance,the tolerances on footwear, such as a pair of shoes, may benefit frommedical-grade accuracy but, as noted above, requiring users to undergomedical-grade 3D scanning to obtain such results may lessen the customerexperience and potentially drive away customers.

A 3D scanning system has been developed that may allow for rapid 3Dscanning with relatively high precision, notwithstanding gaps in thedata that may arise from the speed of the scan. High-precision scans ofa portion of a body part may be obtained quickly, allowing for the factthat the scan may be incomplete. Missing data from the scan is theninterpolated based on demographic data of the subject. A databaseincludes foot scans of a range of subjects along with accompanyingdemographic data of the subjects. By inputting demographic informationof the subject of the instant scan, a system obtains complete scaninformation of demographically related individuals and utilizes thatdata to infer the nature of any gaps in the instant scan. By so doing,attempts to fill in the gaps in the instant scan may be made not on thebasis of straight, mathematical interpolation of the instant scan but byconsidering the physical characteristics of other, demographicallysimilar people.

Further, while a precise scan may allow for inferences to be maderegarding what size of apparel or other objects may fit the scanned bodypart, such analyses may relate in general only to identifyinginterference or collisions between the object and the scanned body part.However, objects such as apparel in particular are not rigid but areconventionally flexible and often desirably conformal with vary degreesof tightness in various locations on the body part. Thus, simplyidentifying points of interference or collisions between, for instance,a shoe and a foot as scanned may not give desired information regardingfit and likely comfort.

The 3D scanning system thus provides not merely points of interferenceor collision between an object and a body part but also a degree of fitor tightness that may be expected to result over the scanned area if agiven object is worn on the body part. As a result, judgments may bemade as to whether or not a desired fit or snugness may be obtained withthe object. The 3D scanning system may present the fit information as aheat map or other visual representation of the degree of interferencebetween the object and the scanned body part.

Furthermore, while 3D scans are taken at discrete times or discrete timeperiods, the characteristics of a body part may tend to change naturallyover time even if the person is not necessarily growing or changing insubstantial ways. For instance, the shape of a person's foot may undergosignificant changes, often temporary, depending on the activities theperson is engaged in. A person who trains for and runs a marathon mayhave a meaningfully different foot shape at the start of their trainingcompared with at the end of their training. A runner who changes from ahighly structured shoe to a minimally structured shoe may utilizedifferent muscles, resulting in the development or atrophy of variousmuscle groups over time. Furthermore, the wear on the runner's shoes maybe of interest in determining what new shoes may be advantageous for therunner in the future

The 3D scanning system may integrate multiple scans over an extendedperiod of time, e.g., days, weeks, months, or years, of one or both ofthe body part and the object that is worn on the body part and interfacewith external information about the subject of the scan to identifyactivity patterns engaged in by the subject. Based on those activitypatterns, the scanning system may make assessments of the effectivenessof the previous recommendation and/or adjustments to futurerecommendations for fittings.

FIG. 1 is a depiction of a 3D scanner 100 in relation to a human foot102, in an example embodiment. The 3D scanner 100 includes scanningelements 104 positioned on a chassis 106 to obtain a scan of any objectin the scanning volume 108. The scanning elements 104 may be any of avariety of scanning elements known in the art, including but not limitedto visible light cameras, laser sensors, sonar sensors, and the like.The scanning elements 104 are arrayed to obtain a wide range of coverageof the foot 102. In various examples, the scanning elements 104 arearrayed to fully cover the foot 102 but gaps in the coverage of the foot102 may be compensated for as disclosed herein.

While the scanner 100 is described with respect to a foot 102, it is tobe understood that the scanner 100 may be sized to admit both of asubject's feet into the scanning volume 108. In such an example, asingle scan may produce scans of both feet at once. Further, while thescanner 100 is described with respect to a foot 102 specifically, it isto be understood that the principles described are applicable to anybody part or any other object.

The scanner 100 may obtain a scan of the foot 102 based on the foot 102remaining in the scanning volume 108 for a predetermined time. The scanmay be relatively more complete and accurate the longer the foot 102 isin the scanning volume 108. As such, if the foot 102 passes through thescanning volume 108 relatively quickly, e.g., on the order of one (1)second or less, or if the scanner 100 is deliberately set for arelatively fast scan time, then the resultant scan of the foot 102 maybe incomplete or otherwise inaccurate.

Further, the accuracy of the scan may be reduced unless the foot 102 isbare or otherwise unencumbered with other objects. In certaincircumstances, however, a subject may be uncomfortable or otherwiseunwilling or unable to have their foot 102 be unencumbered. In such anexample, portions of the foot 102 that are obscured may not beaccurately scanned.

FIG. 2 is a block system diagram 200 of electronics of the scanner 100and/or a system related to or including the scanner, in an exampleembodiment. A processor 202 is coupled to the scanning elements 104. Theprocessor 202 receives a scanning element output from each of thescanning elements 104 and processes the output to generate a 3Drendering of the foot 102 according to methodologies known in the art.

The processor 202 is further coupled to an electronic data storage 204and a user interface 206. The electronic data storage 204 may be localor remote data storage as well known in the art. The electronic datastorage 204 provides storage for, among other data, a database 208. Thedatabase 208 includes data fields for: a unique subject identifier 210;data related to a 3D scan 212 of the subject's foot 102; demographicinformation 214 of the subject; and activity information 216 of thesubject. The demographic information 214 optionally includes fields forage, sex, height, weight, race, and any other information about 3D scansubjects that may be of interest for the purposes disclosed herein. Thedemographic information 214 and or the database 208 generally mayfurther include subjective information about the subject and thesubject's foot 102 that may be input by a user, such as the subject, viaa user interface, as disclosed herein. The activity information 216 mayinclude information related to activities, such as physical activitiesthat have been performed by the subject, such as a category of theactivity (e.g., running, cycling, swimming, etc.), a time and durationof the activity, an amount of activity (e.g., a distancerun/cycled/swum, etc.), and equipment used in the activities, includingcharacteristics of the equipment and changes in the equipment over timeas the equipment has been used, among other activity information asdesired and as appropriate.

The user interface 206 is configured to display the 3D scan as obtainedand/or information related to the 3D scan or recommendations basedthereon. The user interface 206 includes a visual display and,optionally, a user input device, such as a keyboard, touchscreen, andthe like. While the components of the block system diagram 200 are showncoupled together directly, e.g., as part of a single, unitary device, itis emphasized that any or all of the components may be remote,distributed, redundant, and the like to allow for a flexible andaccessible system. Thus, in an example, the processor 202, theelectronic data storage 204, and the user interface 206 are componentsof a user device, such as a mobile device, e.g., a smartphone or tabletcomputer, or a personal computer, such as a laptop computer, desktopcomputer, or workstation, among any of a variety of additionalimplementations.

The 3D models of articles of footwear may be stored in the database 208and/or in the electronic data storage 204 generally as footwear models218 or may be obtained from any other suitable source. The 3D models mayincorporate not just a shape of an associated article of footwear butphysical properties of the article of footwear, including an elasticityor general flexibility of the materials that make up the article offootwear.

FIG. 3 is a flowchart 300 for using demographic data 214 to interpolateportions of the foot 102 from the 3D scan, in an example embodiment. Theinterpolation may be based on portions of the 3D scan that accuratelydepict the foot in order to inter a geometry or contour of the foot 102in portions of the 3D scan that are not obtained or that include datathat is not likely to be a valid or otherwise accurate 3D rendering ofthe foot 102.

At 302, the scanner 100 obtains 3D scan data of the foot 102 using thescanning elements 104 and optionally stores the data as 3D scan data 212in the database 208.

At 304, the processor 202 analyzes the 3D scan data, either as accessedfrom the database 208 or directly from the scanning elements 104, toidentify aspects of the 3D data that are missing or are suspected ofbeing an inaccurate depiction of foot 102. The processor 202 mayidentify inaccurate or missing regions based on conventional imagerecognition methods known in the art, including by identifying regionsof the 3D scan that lack a threshold level of definition or clarity,that show surfaces that are flatter than a predetermined thresholdlevel, or that otherwise are not or cannot be identified as being partof a human foot 102.

Additionally or alternatively, the analysis of the 3D scan data may beperformed by a human operator. In such an example, the processor 202causes the 3D scan data 212 to be rendered on the user interface 206 forreview by the operator. The operator may then utilize a user inputdevice to mark regions of the scan that are missing or inaccurate. Forinstance, the operator may utilize a mouse, touchscreen, or othergraphic input device to draw a boundary around regions that appear to bemissing or inaccurate in order to designate those regions forinterpolation in subsequent operations of the flowchart 300.

At 306, the processor 202 determines if inaccurate or incomplete regionsof the 3D scan 212 have been identified. If so, the processor proceedsto 308 to interpolate characteristics of the missing data based ondemographic information 214. If not, the processor proceeds to 322 todisplay the 3D scan on the user interface.

At 308, the processor 202 utilizes conventional image recognitionmechanisms to identify one or more reference features on the 3D scandata of the foot 102. The reference features may be any plainlyidentifiable feature conventionally associated with a foot 102,including toes/toe nails, the heel, an ankle (which is notconventionally included as part of the foot 102 but which may have beenincluded in the 3D scan'), an arch, and the like. It is noted that ifthe 3D scan data 212 is so incomplete that it is impossible to recognizesufficient reference features then the flowchart 300 may terminate andvariously display the 3D scan without interpolation or provide a messagethat the 3D scan cannot be used, among other possible outcomes.

At 310, the processor 202 obtains demographic information of the subjectof the 3D scan. The operator may enter at least a unique subjectidentifier of the subject via the user interface 206. If the subjectalready has corresponding demographic information 214 in the database208 then the processor 202 may access that information 214. The operatoror subject may additionally or alternatively enter demographicinformation, either new or updated, via the user interface 206. Theprocessor 202 may optionally store the demographic information asentered in the database 208.

At 312, the processor 202 identifies demographically similar subjects tothe subject of the 3D scan that already have 3D scan data 212 in thedatabase 208. Demographic similarity may be based on any demographiccategory stored in the demographic information 214 and as detailedherein. In an example, demographic similarity is determined based on anumber of categories of a stored subject that are within a bound ofthose of the instant subject. Thus, for instance, if the instant subjectis thirty-three years old then stored subjects may be demographicallysimilar in the age category if they are between the ages of thirty-oneand thirty-five, inclusive. The instant and stored subjects may bedemographically similar based on sex by having the same sex. The instantand stored subjects may be demographically similar based on height byhaving the same height plus-or-minus one inch, and so forth.

It is noted and emphasized that the precise process by which demographicsimilarity is determined may be dependent on a variety of factors,including the size of the population of stored subjects in the database208. Thus, if the population of stored subjects is very large thendemographic similarity may be based on very tight tolerances while, ifthe population of stored subjects is small then demographic similaritymay be relatively loose. In an example, the processor 202 may adjust thetolerances on identifying demographic similarity in order to produce apopulation of one hundred (100) of the most demographically similarstored subjects among the subjects stored in the database 208. Thenumber of demographically similar stored subjects identified may bevaried based on the size of the population of stored subjects and thecomputing resources of the processor 202.

At 314, the processor 202 develops a composite 3D image among thedemographically similar stored subjects by accessing the 3D scans 212 ofthose stored subjects and averaging their 3D scans or otherwise applyingoperations that are utilized in the art to generate composites ofmultiple individual items.

At 316, the processor 202 normalizes the size of the composite 3D imageto the size of the 3D scan of the instant subject based on the referencefeatures of the composite 3D image in relation to the instant 3D scan.In other words, if the instant 3D scan is 10.5 inches from toe-to-heeland 4.25 inches at the widest point (among other measurable features)then the composite 3D image is normalized to have the same measurements.

At 318, the processor 202 overlays the regions that have been identifiedas being incomplete or inaccurate from the instant 3D scan onto thecomposite 3D scan.

At 320, the processor 202 transfers the 3D scan data corresponding tothe overlaid regions from the composite 3D scan to the instant 3D scandata.

At 322, the processor 202 causes the instant 3D scan to be displayed onthe user interface and/or stored as 3D scan data 212 in the database208. The instant 3D scan as displayed reflects the updated orinterpolated 3D scan data from the composite 3D scan if the originalinstant 3D scan data included incomplete or inaccurate regions. If theinstant 3D scan did not include incomplete or inaccurate regions thenthe instant 3D scan is simply displayed and/or stored as originallyobtained by the scanning elements 104. The operations from 302 to 322may be repeated to cause display of the 3D scan as an animation.

FIG. 4 is a heat diagram 400 of a 3D scan 402 of a foot 102 as displayedon the user interface 206, in an example embodiment. The 3D scan 402 ofthe foot 102 may be obtained according to the flowchart 300 but it isnoted and emphasized that any complete or otherwise accurate 3D scan 402of the foot 102 may be obtained and utilized. The heat diagram 400presents the 3D scan 402 of the foot 102 in relation to 3D models ofarticles of footwear.

As illustrated, the heat diagram 400 provides heat zones 404, isobars,or other graphical representations of a degree of interaction betweenthe 3D scan 402 and the model of the article of footwear. Specifically,in the illustrated example, the heat zones 404 are indicative of adegree of tightness of the materials of the article of footwear inrelation to the foot 102. Thus, heat zones 404 range from tight zones404A to loose zones 404B and gradations between. The heat zones 404 mayrepresent absolute degrees of tightness of the article of footwear inthe given regions of the foot 102 based, in an example, on a degree ofdeformation of the article of apparel in relation to the elasticity ofthe local material. Thus, if, to fit the foot 102, a substantiallyinelastic portion of the article of footwear had to deform relativelysignificantly to fit the foot 102 then that region may correspond to atight zone 404A, while a region of the article of footwear that didn'thave to deform at all to fit the foot 102 would correspond to a loosezone 404B. A region where a relatively elastic portion of the article offootwear would deform moderately to fit the foot 102 may correspond to amoderate zone 404 between the tight zones 404A and loose zones 404B.

Itis noted that, in the illustrated example, the article of footwear isnot depicted in relation to the 3D scan 402. In the illustrated example,the appearance of the article of footwear itself is superfluous inrelation to how the article of footwear may be expected to fit on thefoot 102. However, various implementations of the heat map 400 mayinclude a depiction of the article of footwear overlaying the 3D scan402.

On the basis of the heat map, an operator or the subject of the 3D scanmay observe the heat diagram 400 and see how a given article of footwearmay be expected to fit on the subject's foot 102. The processor 202 maysequentially or iteratively apply different sizes, makes, and models ofarticles of footwear to the 3D scan 402 in order to display how thosesizes, makes, and models of footwear will tend to fit on the foot 102.

In various examples, on the basis of the heat diagrams 400 that aregenerated by the processor 202 from applying various sizes, makes, andmodels of articles of footwear to the 3D scan 402, the processor 202 mayidentify certain sizes, makes, and models that may be recommended forthe foot 102. The tightest zones 404A may be deemed to be undesirablewhile too many loose zones 404B may likewise be undesirable. Thus, in anexample, the processor 202 may decline to recommend any article offootwear that has a tight zone 404A and any article of footwear that hasmore than twenty-five percent loose zones 404B. The processor 202 may,based on feedback form multiple subjects, identify a overall tightnesscharacteristic that tends to be preferred by subjects of the 3D scan,However, it is emphasized that the desirability of tightness in anarticle of footwear may be highly subjective based on the wearer'spreferences and general, objective criteria for recommended fit may beimpossible or not applicable to all wearers.

FIG. 5 is a flowchart 500 for evaluating changing characteristics of afoot 102 or article of footwear over time, in an example embodiment.While the flowchart 500 is described with respect to the 3D scanner 100and the system 200 generally, it is to be recognized and understood thatthe flowchart 500 may be implemented on or with respect to any suitable3D scanner or system. Further, as is the case throughout this document,while the flowchart 500 is described specifically with respect to thefoot 102 and to an article of footwear, it is to be understood that theprinciples disclosed herein are applicable to a body part in general andto an article of apparel.

At 502, the processor 202 downloads from the database 208 first 3D scandata of one or both of a foot 102 and an article of footwear from afirst time earlier than a time of the downloading of the 3D scan data.

At 504, the processor 202 obtains second 3D scan data from the one orboth of the foot 102 and the article of footwear. In an example, theprocessor 202 obtains the second 3D scan data directly from the 3Dscanner 100 and the scanning elements 104. Alternatively, the processor202 accesses or downloads the second 3D scan data 212 from the database208. In such an example, the second 3D scan data 212 obtained from thedatabase 208 at 504 is at a second time later than the first time fromwhich the first 3D scan data 212 obtained from the database 208 wasgenerated.

At 506, the processor 202 identifies differences in the contours betweenthe first 3D scan data and the second 3D scan data. In the case of thefoot 102, the differences in the 3D scan data may reflect aphysiological change in the foot 102 and features of the foot 102, suchas swelling or flattening of an arch, the development or atrophy ofmuscles, among any of a variety of detectable physiological changes inthe foot 102. In the case of the article of footwear, the differences inthe 3D scan data may reflect wear or structural deterioration of thearticle of footwear. In various examples, the wear may be reflected indeterioration of a tread on an outsole, among other forms of wear, whilestructural deterioration may be reflected in a sag or other distortionin the structure of the article of footwear when the article of footwearis sitting without an external force being applied to the article offootwear.

At 508, the processor 202 obtains activity information 216 of the personto whom the foot 102 and/or article of footwear corresponds. Theactivity data 216 may be obtained from a fitness tracker associated withthe person, from input into the user interface 206, or any othersuitable source of activity information.

The activity information may cover both the nature of the activitiesthemselves as well as equipment and apparel utilized in the activities.Thus, the activity information may specify both that the subject ranvarious distances at various times as well as the shoes that the subjectwore while doing so. If, for instance, the activity information reflectsthat the subject changed footwear at some point, for instance bytransitioning from a shoe that is structured so as to providesignificant support to the foot to a shoe that is structured to providelittle support to the foot, the activity information may inform theinterpretation of any physiological change in the musculature of thefoot 102 that may result from using or not using various muscle groups.

At 510, the processor 202 compares typical physiological changes in thefoot 102 from identified activities or typical wearing on an article offootwear from an amount of use with actual physiological changes and/oractual wear on the article of footwear to identify changes from thefirst time to the second time that are aberrant in comparison withtypical or expected changes. By way of example, while foot 102 swellingmay be expected of approximately five percent while a runner is trainingfor a marathon, swelling of ten percent may be indicative of a need forbetter support in running footwear that is being worn by the runner. Byway of further example, if the wear on the outsole of a shoe is not evenbut rather concentrated in certain locations the runner may beexperiencing collapsing arches, indicating a need for greater archsupport in the runner's footwear.

At 512, the user interface 206 displays information indicative of thechanges in the foot 102 and/or article of footwear and, optionally, anassessment or recommendation in view of the changes in the foot 102and/or article of footwear. The recommendation may be in regards to thepurchase or acquisition of a new article of footwear or other piece ofequipment or a recommendation for a change in activity patterns, asappropriate. The information indicative of the changes in the foot 102and/or article of footwear may be in percentage terms, graphicalrepresentations, or any suitable representation of the change.

In various examples, if activity information reflects that the subjecthas changed equipment over time, the assessment may reflect how thesubject may have been expected to react to the change in equipment.Thus, in the above example of switching from a high-structure shoe to alow-structure shoe, the musculature of the foot 102 may be expected tochange in certain ways as the subject acclimates to the new lack ofsupport from the shoe. The assessment may reflect the degree to whichthe subject has or has not adapted to the change in shoe and may providethe basis for a recommendation to change a running style (e.g., land ona forefoot rather than a heel), a change in a running amount (e.g.,reduce running distance by 50% for one month), or a change in shoes(e.g., return to a high-structure model).

Upon displaying the information indicative of changes, the flowchart 500may wait for a third 3D scan at a third time in the future to beobtained. Upon obtaining the third 3D scan, the flowchart may return to506 to identify differences in the contours from the first and second 3Dscans to the third 3D scan and continue through the flowchart 500 basedon having three sets of 3D scans. The flowchart 500 may continueiteratively or sequentially with additional 3D scans at different times,with the additional 3D scans being utilized as additional data points ordata sets to identify changes in the foot 102 and/or article offootwear. The activity information 216 would be further updated and newrecommendations generated based on the differences in the changesrelative to expected changes over the period of time.

FIGS. 6A-6D are depictions of a user interface screen 600 of the userinterface 206, in an example embodiment. As disclosed herein, the userinterface screen 600 may be utilized to output information regarding 3Dscans of the foot 102 as well as recommendations for footwear basedthereon. Additionally or alternatively, the user interface screen 600may be utilized to facilitate obtaining subjective information about thefoot 102 from a user of the user interface screen 600. Such subjectiveinformation may be utilized in addition to the 3D scan information orinstead of the 3D scan information as a virtual 3D scan according to theprinciples disclosed herein.

In an example, the user interface screen 600 displays a virtual foot 602at various times. The difference between the first time and the secondtime may be relatively short (seconds or fractions of a second), as inanimation of the virtual foot 602, or relatively long (hours, days,weeks, or more) to show physiologic changes in the virtual foot 602. Theuser interface screen 600 further discloses a prompt field 604 on whichquestions and/or directions may be displayed and a response field 606 inwhich a user may input data in response to the prompt. The virtual foot602 itself may function as a visual response field, as disclosed herein.In various examples, the virtual foot 602 may be a generic image of afoot selected from the models 218 based on the demographic data 214, ifavailable, or without respect to any other data. Alternatively, thevirtual foot 602 may be based on the 3D scan obtained as disclosedherein. The iterative changing of the virtual foot 602 may serve, invarious instances, to refine the interpolation of the missing elementsof the foot 102 or may operate instead of interpolating missingelements. As such, the operations disclosed herein may be conductedeither as a refinement of the previously obtained 3D model or as a wayof obtaining subjective information from the user of the user interface206 without regard to or without need for a 3D scan of the foot 102.

In various examples, the processor 202 causes the user interface screen600 to prompt the user iteratively to identify differences between thefoot 102 and the virtual foot 602, update the virtual foot 602 asdisplayed, and then prompt the user for further differences between thefoot 102 and virtual foot 602 until the virtual foot 602 approximatesthe foot 102 based on the subjective opinion of the user. While thedisclosure herein refers to the foot 102 as being of the user, it is tobe understood that the user of the user device 206 may be someone actingon behalf of the foot 102 that is the subject of the scan. For thepurposes of simplicity, however, this will be referred herein to simplythe user and the foot 102 of the user without limitation on the abilityof the user to perform the same actions on the behalf of another person.

The processor 202 may further prompt the user to input information aboutcurrent or past articles of footwear the user has worn and how thearticle of footwear feels or has felt. Such information about pastarticles of footwear may be utilized for a baseline virtual foot 602and/or to provide recommendation for articles of footwear following userinputting the subjective information,

FIG. 6A illustrates the user interface screen 600 prompting the user forcurrent or past articles of footwear the user has worn. in theillustrated example, the prompt field 604 prompts the user to enter thebrand, model, and size of a current or recently worn article offootwear, in the illustrated example a running shoe. The response field606 includes dropdown menus 608 corresponding to brand, model, and sizeof running shoes included in the models 218. The user may select suchcharacteristics using the dropdown menus 608 if the information is knownor may select a pick box 610 indicating that the user does not havecurrent or recent running shoes or the running shoes the user currentlyhas are not included in the dropdown menus 608. The prompt and responsesare not exhaustive, and it is emphasized that additional information maybe obtained, e.g., general satisfaction of the user with their currentor recent running shoe, running style (heel strike, forefoot strike,midfoot strike, etc.) and so forth. Further, information, such as footsize, may be entered without respect to a currently or recently wornshoe. Upon entering the relevant information as appropriate in theresponse field 606, the user may select the ENTER button 612 to proceedto the user interface screen 600 as depicted in FIG. 6B.

FIG. 6B illustrates the user interface screen 600 prompting the user toenter points of discomfort 614 on the virtual foot 602 caused by theircurrent or recent running shoe. In such a case, the user interface 206may include a. touchscreen to allow the user to select locations on thevirtual foot 602 or may include a cursor (not pictured) controlled by amouse, trackball, touchpad, or other input mechanism. It is noted that,while the virtual foot 602 as depicted is the bottom of the foot, atop-down image of the virtual foot 602 may be displayed in addition orinstead of the bottom image. Points of discomfort may correspond to heatzones as disclosed herein, points of snugness or looseness, or anyaspect of the article of footwear that does not feel right to the user.Upon entering either the points of discomfort 614 or indicating thatnone exist or points of discomfort are not applicable then the user mayselect the ENTER button 612 to proceed to the user interface screen 600as depicted in FIG. 6C. It is noted that, if the user indicates that theuser does not have current or recent running shoes in the precedingscreen that the user interface screen 600 of FIG. 6B may be skipped oromitted.

FIG. 6C illustrates the user interface screen 600 prompting the user tosubjectively and iteratively indicate the general characteristics oftheir own foot by changing the appearance of the virtual foot 602. Theprompt field 604 variously prompts the user to indicate that parts ofthe virtual foot 602 should change or stay the same. Such parts mayinclude, without limitation, the user's relative toe length (asillustrated), foot width at various points, arches, and heel, among anyof a variety of characteristics of the anatomy of the foot. Using theresponse field 606, the user may indicate that the prompted parts shouldchange in various ways or stay the same. In the case of the toes asillustrated, the big toe, second toe, and other toes may variously bemade longer, shorter, or stay the same using the dropdown menus 608.

If the user inputs “SAME” for all dropdown menus 608 and selects ENTERit is understood that the user considers the prompted parts of theirfoot to correspond to the virtual foot 602 as currently shown. In thatcase, the user interface screen 600 may be displayed again with a promptfor a different part of the foot or, if all parts of the foot for whichinformation may be obtained have been prompted and answered, the userinterface screen 600 may be displayed as in FIG. 6D. If not, theappearance of the virtual foot 602 is updated based on the responses andredisplayed. For instance, if the user has entered responses asillustrated in FIG. 6C, the virtual foot 602 in a subsequent renderingmay depict the big toe, e.g., five percent shorter, the second toe fivepercent longer, and the other toes in their previously presentedconfiguration. The user may iteratively update the appearance of thetoes until the user believes the toes of the virtual foot 602approximately correspond to the user's toes, and then iteratively updatethe additional features of the virtual foot 602 until user believes thevirtual foot 602, or various aspects thereof, approximately correspondsto the associated aspects of the user's own foot.

Additionally or alternatively, in various examples, the user may“drag-and-drop” aspects of the virtual foot 602. to change theappearance of the virtual foot 602 to conform to the user's own foot.Thus, for instance, the user may select and shorten the big toe, selectand lengthen the second toe, widen the foot, and so forth, and thenselect ENTER when satisfied that the virtual foot 602 corresponds to theuser's own foot. In such a case, iterative updating of the footdescribed above may be dispensed with or provided as an additionalmechanism to adjust the appearance of the virtual foot 602.

FIG. 6D illustrates the user interface screen 600 providing arecommendation for a running shoe based on the user input as describedherein. The recommendation may be based on the input provided via theuser interface screen 600 as well as the 3D scan as obtained, in variousexamples. The recommendation is displayed in the prompt field 604 andindicates at least one recommendation for a running shoe, including abrand, a model, and a size. It is noted that for purposes of exampleillustration, the user in FIG. 6A indicated having worn brand X, modelA, size 6.5, while the recommendation is for brand X, model B, size 7.Thus, in such an example, the process may have determined that a largersize of a different model shoe would be a better fit for the user basedon the responses as entered and by a relationship of the model 218corresponding to the model A shoe in relation to the model 218corresponding to the model B shoe.

It is noted that where objective information about the foot of the useris not available,

FIG. 7 is a flowchart 700 for iteratively updating a virtual foot 602based on user responses, in an example embodiment. The flowchart 700 isbased on use of aspects of the system 200 and prompts and responses onthe user interface screen 600. However, it is to be recognized andunderstood that any suitable system and/or user interface screen may beutilized. Further, while various operations are presented as part of theflowchart 700, it is to be understood that various operations areoptional and may be omitted as appropriate to various implementationconditions and/or circumstances.

At 702, the processor 202 causes the user interface screen 600 to promptthe user via the prompt field 604 for information about a currently orrecently worn article of footwear, as illustrated in FIG. 6A.

At 704, the user enters information about one or more currently orrecently worn articles of footwear via the response field 606.

At 706, the processor 202 causes the user interface screen 600 to promptthe user via the prompt field 604 for feedback regarding a current orrecently worn article of footwear, as illustrated in FIG. 6B.

At 708, the user enters information about areas of discomfort from thecurrent or recently worn article of footwear, including indicatingpoints of discomfort 614 on the virtual foot 602 induced by the currentor recently worn article of footwear.

At 710, the processor 202 causes the user interface screen 600 todisplay the virtual foot 602 as iteratively updated herein. In a firstinstance, the virtual foot 602 may be a generic foot. Additionally oralternatively, the processor 202 may obtain or provide a 3D model of theuser's foot 102 as disclosed herein. Subsequent displays of the virtualfoot 602 may be as iteratively updated, as illustrated in FIG. 6C.

At 712, the processor 202 causes the user interface screen 600 to promptthe user to change one or more subject parts of the virtual foot 602 toimprove a similarity between the virtual foot 602 and a foot 102 of theuser.

At 714, the user utilizes the user interface screen 600 to enter aninput to either change or not change the subject part of the virtualfoot 602.

At 716, the processor 202 determines if the user has completed updatingthe subject part, e.g., because the user has indicated that the subjectpart(s) are substantially the same as the foot 102. If the user hascompleted updating the subject part then the processor 202 proceeds tooperation 718. If not, the processor 202 proceeds to operation 710 toiteratively update the subject part of the virtual foot 602.

At 718, the processor 202 determines if the user has updated all of theparts of the virtual foot 602 subject to being updated. If not, theprocessor 202 proceeds to operation 720. If so, the processor proceedsto operation 722.

At 720, the processor 202 changes the subject part of the virtual foot602. For instance, if the subject part of the virtual foot 602 are thetoes, as illustrated in FIG. 6C, and the user indicates that the toes donot need to change further, then the processor 202 may change thesubject part to the width of the foot. The processor 202 then proceedsto operation 710 to present and iteratively update the new subject part.

At 722, the processor 202 obtains models 218 of articles of footwear.The processor 202 may variously obtain all models 218 of relevantfootwear types, e.g., running shoes in the illustrated examples, allmodels 218, or only a subset of models 218 of a type based on variousassumptions. For instance, if the user has indicated that the user is awomen's size 6.5 and is looking for running shoes, then the processor202 may only obtain models 218 for running shoes in women's sizes 5.5through 7.5 while omitting other types and sizes.

At 724, the processor 202 compares the virtual foot 602 against models218 of articles of footwear as obtained according to the principlesdisclosed herein, e.g., with respect to heat zones 404 or lack thereofby overlaying the models 218 of articles of footwear on the virtual foot602. The processor 202 may identify various models of articles offootwear which meet various requirements for heat zones 404 or lackthereof to indicate a suitable fit. In an example, the processor 202 mayidentify a single best-fit model 218 or may identify multiple models 218which fit.

A model 218 may fit based on the number and significance of heat zones404. In an example, a model 218 may fit the virtual foot 602 if themodel 218 has only two heat zones 404, neither greater than apredetermined maximum amount of interference. The predetermined maximum,and the number of heat zones 404, may vary among footwear types. Thus,in an example, a running shoe may allow for more heat zones 404 but withrelatively less amount of interference in each heat zone 404 than awalking shoe. The details of the suitable fit for a model 218 may behighly situation dependent and thus may be separately determined forvarious models 218.

At 726, the processor 202 may cross-reference one or more of the models218 selected as being fits for the virtual foot 602 against feedbackobtained at operation 708. Thus, in an example, if the user hasindicated that the user subjectively feels jarring impacts with a brandX, model A shoe with a heel strike running style, the processor 202 maynote that a brand X, model B shoe may be preferred for heel strikingover the model A shoe. In such an example, the processor 202 maysubjectively rank the model B shoe for the user over the model A, evenif the fit analysis at operation 724 suggests that the model A may bethe best fit running shoe for the user.

At 728, the processor 202 causes the user interface screen 600 todisplay a recommended article of footwear, as illustrated in FIG. 6D.The recommendation may include multiple recommendations for articles offootwear, including explanations. For instance, in the above example,the processor 202 may display recommendations for both the model A andmodel B running shoes but may explain that the model B running shoe maybe preferred owing to the feedback about the model A obtained atoperation 708.

FIG. 8 is a block diagram illustrating components of a machine 800,according to some example embodiments, able to read instructions from amachine-readable medium (e.g., a machine-readable storage medium) andperform any one or more of the methodologies discussed herein.Specifically, FIG. 6 shows a diagrammatic representation of the machine800 in the example form of a computer system and within whichinstructions 824 (e.g., software) for causing the machine 800 to performany one or more of the methodologies discussed herein may be executed.In alternative embodiments, the machine 800 operates as a standalonedevice or may be connected (e.g., networked) to other machines. In anetworked deployment, the machine 800 may operate in the capacity of aserver machine or a client machine in a server-client networkenvironment, or as a peer machine in a peer-to-peer (or distributed)network environment. The machine 800 may be a server computer, a clientcomputer, a personal computer (PC), a tablet computer, a laptopcomputer, a netbook, a set-top box (STB), a personal digital assistant(PDA), a cellular telephone, a smartphone, a web appliance, a networkrouter, a network switch, a network bridge, or any machine capable ofexecuting the instructions 824, sequentially or otherwise, that specifyactions to be taken by that machine. Further, while only a singlemachine is illustrated, the term “machine” shall also be taken toinclude a collection of machines that individually or jointly executethe instructions 824 to perform any one or more of the methodologiesdiscussed herein.

The machine 800 includes a processor 802 (e.g., a central processingunit (CPU), a graphics processing unit (GPU), a digital signal processor(DSP), an application specific integrated circuit (ASIC), aradio-frequency integrated circuit (RFIC), or any suitable combinationthereof), a main memory 804, and a static memory 806, which areconfigured to communicate with each other via a bus 808. The machine 800may further include a graphics display 810 (e.g., a plasma display panel(PDP), a light emitting diode (LED) display, a liquid crystal display(LCD), a projector, or a cathode ray tube (CRT)). The machine 800 mayalso include an alphanumeric input device 812 (e.g., a keyboard), acursor control device 814 (e.g., a mouse, a touchpad, a trackball, ajoystick, a motion sensor, or other pointing instrument), a storage unit816, a signal generation device 818 (e.g., a speaker), and a networkinterface device 820.

The storage unit 816 includes a machine-readable medium 822 on which isstored the instructions 824 (e.g., software) embodying any one or moreof the methodologies or functions described herein. The instructions 824may also reside, completely or at least partially, within the mainmemory 804, within the processor 802 (e.g., within the processor's cachememory), or both, during execution thereof by the machine 800.Accordingly, the main memory 804 and the processor 802 may be consideredas machine-readable media. The instructions 824 may be transmitted orreceived over a network 826 via the network interface device 820.

As used herein, the term “memory” refers to a machine-readable mediumable to store data temporarily or permanently and may be taken toinclude, but not be limited to, random-access memory (RAM), read-onlymemory (ROM), buffer memory, flash memory, ferroelectric RAM (FRAM), andcache memory. The term “machine-readable medium” should be taken toinclude a single medium or multiple media (e.g., a centralized ordistributed database, or associated caches and servers) able to storeinstructions. The term “machine-readable medium” shall also be taken toinclude any medium, or combination of multiple media, that is capable ofstoring instructions (e.g., software) for execution by a machine, suchthat the instructions, when executed by one or more processors of themachine, cause the machine to perform any one or more of themethodologies described herein. Accordingly, a “machine-readable medium”refers to a single storage apparatus or device, as well as “cloud-based”storage systems or storage networks that include multiple storageapparatus or devices. The term “machine-readable medium” shallaccordingly be taken to include, but not be limited to, one or more datarepositories in the form of a solid-state memory, an optical medium, amagnetic medium, or any suitable combination thereof.

Throughout this specification, plural instances may implementcomponents, operations, or structures described as a single instance.Although individual operations of one or more methods are illustratedand described as separate operations, one or more of the individualoperations may be performed concurrently, and nothing requires that theoperations be performed in the order illustrated. Structures andfunctionality presented as separate components in example configurationsmay be implemented as a combined structure or component. Similarly,structures and functionality presented as a single component may beimplemented as separate components. These and other variations,modifications, additions, and improvements fall within the scope of thesubject matter herein.

Certain embodiments are described herein as including logic or a numberof components, modules, or mechanisms. Modules may constitute eithersoftware modules (e.g., code embodied on a machine-readable medium or ina transmission signal) or hardware modules. A “hardware module” is atangible unit capable of performing certain operations and may beconfigured or arranged in a certain physical manner. In various exampleembodiments, one or more computer systems (e.g., a standalone computersystem, a client computer system, or a server computer system) or one ormore hardware modules of a computer system (e.g., a processor or a groupof processors) may be configured by software (e.g., an application orapplication portion) as a hardware module that operates to performcertain operations as described herein.

In some embodiments, a hardware module may be implemented mechanically,electronically, or any suitable combination thereof. For example, ahardware module may include dedicated circuitry or logic that ispermanently configured to perform certain operations. For example, ahardware module may be a special-purpose processor, such as a fieldprogrammable gate array (FPGA) or an ASIC. A hardware module may alsoinclude programmable logic or circuitry that is temporarily configuredby software to perform certain operations. For example, a hardwaremodule may include software encompassed within a general-purposeprocessor or other programmable processor. It will be appreciated thatthe decision to implement a hardware module mechanically, in dedicatedand permanently configured circuitry, or in temporarily configuredcircuitry (e.g., configured by software) may be driven by cost and timeconsiderations.

Accordingly, the phrase “hardware module” should be understood toencompass a tangible entity, be that an entity that is physicallyconstructed, permanently configured (e.g., hardwired), or temporarilyconfigured (e.g., programmed) to operate in a certain manner or toperform certain operations described herein. As used herein,“hardware-implemented module” refers to a hardware module. Consideringembodiments in which hardware modules are temporarily configured (e.g.,programmed), each of the hardware modules need not be configured orinstantiated at any one instance in time. For example, where a hardwaremodule comprises a general-purpose processor configured by software tobecome a special-purpose processor, the general-purpose processor may beconfigured as respectively different special-purpose processors (e.g.,comprising different hardware modules) at different times. Software mayaccordingly configure a processor, for example, to constitute aparticular hardware module at one instance of time and to constitute adifferent hardware module at a different instance of time.

Hardware modules can provide information to, and receive informationfrom, other hardware modules. Accordingly, the described hardwaremodules may be regarded as being communicatively coupled. Where multiplehardware modules exist contemporaneously, communications may be achievedthrough signal transmission (e.g., over appropriate circuits and buses)between or among two or more of the hardware modules. In embodiments inwhich multiple hardware modules are configured or instantiated atdifferent times, communications between such hardware modules may beachieved, for example, through the storage and retrieval of informationin memory structures to which the multiple hardware modules have access.For example, one hardware module may perform an operation and store theoutput of that operation in a memory device to which it iscommunicatively coupled. A further hardware module may then, at a latertime, access the memory device to retrieve and process the storedoutput. Hardware modules may also initiate communications with input oroutput devices, and can operate on a resource (e.g., a collection ofinformation).

The various operations of example methods described herein may beperformed, at least partially, by one or more processors that aretemporarily configured (e.g., by software) or permanently configured toperform the relevant operations. Whether temporarily or permanentlyconfigured, such processors may constitute processor-implemented modulesthat operate to perform one or more operations or functions describedherein. As used herein, “processor-implemented module” refers to ahardware module implemented using one or more processors.

Similarly, the methods described herein may be at least partiallyprocessor-implemented, a processor being an example of hardware. Forexample, at least some of the operations of a method may be performed byone or more processors or processor-implemented modules. Moreover, theone or more processors may also operate to support performance of therelevant operations in a “cloud computing” environment or as a “softwareas a service” (SaaS). For example, at least some of the operations maybe performed by a group of computers (as examples of machines includingprocessors), with these operations being accessible via a network (e.g.,the Internet) and via one or more appropriate interfaces an applicationprogram interface (API)).

The performance of certain of the operations may be distributed amongthe one or more processors, not only residing within a single machine,but deployed across a number of machines. In some example embodiments,the one or more processors or processor-implemented modules may belocated in a single geographic location (e.g., within a homeenvironment, an office environment, or a server farm). In other exampleembodiments, the one or more processors or processor-implemented modulesmay be distributed across a number of geographic locations.

Some portions of this specification are presented in terms of algorithmsor symbolic representations of operations on data stored as bits orbinary digital signals within a machine memory (e.g., a computermemory). These algorithms or symbolic representations are examples oftechniques used by those of ordinary skill in the data processing artsto convey the substance of their work to others skilled in the art. Asused herein, an “algorithm” is a self-consistent sequence of operationsor similar processing leading to a desired result. In this context,algorithms and operations involve physical manipulation of physicalquantities. Typically, but not necessarily, such quantities may take theform of electrical, magnetic, or optical signals capable of beingstored, accessed, transferred, combined, compared, or otherwisemanipulated by a machine. It is convenient at times, principally forreasons of common usage, to refer to such signals using words such as“data,” “content,” “bits,” “values,” “elements,” “symbols,”“characters,” “terms,” “numbers,” “numerals,” or the like. These words,however, are merely convenient labels and are to be associated withappropriate physical quantities.

Unless specifically stated otherwise, discussions herein using wordssuch as “processing,” “computing,” “calculating,” “determining,”“presenting,” “displaying,” or the like may refer to actions orprocesses of a machine (e.g., a computer) that manipulates or transformsdata represented as physical (e.g., electronic, magnetic, or optical)quantities within one or more memories (e.g., volatile memory,non-volatile memory, or any suitable combination thereof), registers, orother machine components that receive, store, transmit, or displayinformation. Furthermore, unless specifically stated otherwise, theterms “a” or “an” are herein used, as is common in patent documents, toinclude one or more than one instance. Finally, as used herein, theconjunction “or” refers to a non-exclusive “or,” unless specificallystated otherwise.

What is claimed is:
 1. A system, comprising: a three-dimensional (3D)scanning element; an electronic data storage configured to store adatabase including fields for 3D scan data and activity data; aprocessor, coupled to the 3D scanning element and the electronic datastorage, configured to: download first 3D scan data from a first timefrom the database; obtain second 3D scan data from a second timedifferent than the first time from the 3D scanning element; determinechanges between the first 3D scan data and the second 3D scan data;obtain activity information from the database; and determine adifference between the changes as determined and anticipated changesbased on the activity information; and a user interface, coupled to theprocessor, configured to present information indicative of thedifference between the changes and the anticipated changes.
 2. Thesystem of claim 1, wherein the information includes a recommendation tochange at least one of an article of equipment or future useractivities.
 3. The system of claim 1, wherein the first and second 3Dscan data relates to a body part of a user and wherein the changesreflect a change in a physiological property of the body part.
 4. Thesystem of claim 3, wherein the anticipated change is based on an articleof equipment being utilized by the user in activities related to theactivity information.
 5. The system of claim 1, wherein the first andsecond 3D scan data relates to an article of equipment and wherein thechanges reflect wear on the article of equipment.
 6. The system of claim5, wherein the anticipated change is based on a user using the articleof equipment in activities related to the activity information.
 7. Thesystem of claim 1, wherein the processor is further configured toiteratively obtain additional 3D scan data at different times, determinethe changes based on all obtained 3D scan data, and determine thedifference changes and the anticipated changes.
 8. A non-transitorycomputer readable medium, comprising instructions which, whenimplemented by a processor, cause the processor to perform operationscomprising: download first 3D scan data from a first time from adatabase including fields for 3D scan data and activity data; obtainsecond 3D scan data from a second time different than the first timefrom the 3D scanning element; determine changes between the first 3Dscan data and the second 3D scan data; obtain activity information fromthe database; determine a difference between the changes as determinedand anticipated changes based on the activity information; and cause auser interface to present information indicative of the differencebetween the changes and the anticipated changes.
 9. The computerreadable medium of claim 8, wherein the information includes arecommendation to change at least one of an article of equipment orfuture user activities.
 10. The computer readable medium of claim 8,wherein the first and second 3D scan data relates to a body part of auser and wherein the changes reflect a change in a physiologicalproperty of the body part.
 11. The computer readable medium of claim 10,wherein the anticipated change is based on an article of equipment beingutilized by the user in activities related to the activity information.12. The computer readable medium of claim 8, wherein the first andsecond 3D scan data relates to an article of equipment and wherein thechanges reflect wear on the article of equipment.
 13. The computerreadable medium of claim 12, wherein the anticipated change is based ona user using the article of equipment in activities related to theactivity information.
 14. The computer readable medium of claim 8,further comprising instructions which cause the processor to iterativelyobtain additional 3D scan data at different times, determine the changesbased on all obtained 3D scan data, and determine the difference changesand the anticipated changes.
 15. A processor-implemented method,comprising: downloading first 3D scan data from a first time from adatabase including fields for 3D scan data and activity data; obtainingsecond 3D scan data from a second time different than the first timefrom the 3D scanning element; determining changes between the first 3Dscan data and the second 3D scan data; obtaining activity informationfrom the database; determining a difference between the changes asdetermined and anticipated changes based on the activity information;and causing a user interface to present information indicative of thedifference between the changes and the anticipated changes.
 16. Themethod of claim
 8. wherein the information includes a recommendation tochange at least one of an article of equipment or future useractivities.
 17. The method of claim 8, wherein the first and second 3Dscan data relates to a body part of a user and wherein the changesreflect a change in a physiological property of the body part.
 18. Themethod of claim 10, wherein the anticipated change is based on anarticle of equipment being utilized by the user in activities related tothe activity information.
 19. The method of claim 8, wherein the firstand second 3D scan data relates to an article of equipment and whereinthe changes reflect wear on the article of equipment.
 20. The method ofclaim 12, wherein the anticipated change is based on a user using thearticle of equipment in activities related to the activity information.